Rigorously Collecting Commonsense Judgments for Complex Question-Answer Content
نویسندگان
چکیده
Community Question Answering (CQA) websites are a popular tool for internet users to fulfill diverse information needs. Posted questions can be multiple sentences long and span diverse domains. They go beyond factoid questions and can be conversational, opinion-seeking and experiential questions, that might have multiple, potentially conflicting, useful answers from different users. In this paper, we describe a large-scale formative study to collect commonsense properties of questions and answers from 18 diverse communities from stackexchange.com. We collected 50,000 human judgments on 500 question-answer pairs. Commonsense properties are features that humans can extract and characterize reliably by using their commonsense knowledge and native language skills, and no special domain expertise is assumed. We report results and suggestions for designing human computation tasks for collecting commonsense semantic judgments.
منابع مشابه
Using Answer Set Programming To Answer Complex Queries
In this paper we discuss the applicability of the knowledge representation and reasoning language AnsProlog for the design and implementation of query answering systems. We consider a motivating example, and illustrate how AnsProlog can be used to represent defaults, causal relations, and other types of commonsense knowledge needed to properly answer non-trivial questions about the example’s do...
متن کاملAn Approach to Solve Winograd Schema Challenge Using Automatically Extracted Commonsense Knowledge
The Winograd Schema Challenge has recently been proposed as an alternative to the Turing test. A Winograd Schema consists of a sentence and question pair such that the answer to the question depends on the resolution of a definite pronoun in the sentence. The answer is fairly intuitive for humans but is difficult for machines because it requires commonsense knowledge about words or concepts in ...
متن کاملReasoning and intuiting the standards for judgments
What is the extension to which the act of reasoning and the standards of judgments are interrelated? The author, proposing Muslim scholars` views in the field and relying on traditions, ahadith, has concluded that firstly one has to answer the question: does the standard and expediency of Divine judgment lies in the judgment or in its object? The latter is signified, however, with view to so...
متن کاملWhat is in that picture ? Visual Question Answering System
Visual Question Answering is a complex task which aims at answering a question about an image. This task requires multimodal representation learning for both images and text. To solve this problem, an image and text representation is required and high level interactions between the two must be carefully encoded into the model in order to provide the correct answer. The answers can be a word, a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016